Claims 



[cl ] 1 . A method for registering a plurality of image sets, wherein each of the 

plurality of image sets comprises at least one image, and wherein each of the 
plurality of image sets contain spatially overlapping areas of an imaged subject 
with at least one of the remaining plurality of the image sets, the method 
comprising: 

selecting a reference image set and an evaluation image set from said plurality 
of image sets, wherein the evaluation image set is to be aligned with the 
reference image set; 

selecting a methodology for comparing of the registration between the 
reference image set and the evaluation image set; 

selecting one or more point locations on the evaluation image set for tracking 
image movement; 

selecting one or more fixed reference points for comparison with the one or 
more point locations on the evaluation image set; 
selecting type of transformation to apply to the evaluation image set for 
aligning the evaluation image set with the reference image set; 

a) calculating quality of alignment between the reference image set and the 
evaluation image set using a selected quality of alignment methodology; 

b) calculating a location value (C) from one or more points on the evaluation 
image set with respect to the selected one or more fixed reference points and 
storing the calculation in the memory; 

c) calculating a next transformation to apply to the evaluation image; 

d) applying the transformation to at least a subset of the evaluation image set; 

e) calculating a convergence value (V) for the current iteration (i), and storing 
the convergence value to the memory; 

f) performing steps (a), (b) (c), (d) and (e) until at least a predetermined number 
of correspondence calculation iterations have been performed; and 

g) repeating steps (a), (b), (c), (d), and (e) if a total number of iterations (i) 
performed < N and the convergence value (V) < (t), wherein (t) is a threshold 
value. 

[c2] 

2. The method for registering a plurality of image sets according to Claim 1 , 
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wherein calculating correspondence further includes calculating Mutual 
Information between the reference image set and the evaluation image set. 



[c3] 3. The method for registering a plurality of images sets according to Claim 2, 

wherein the Mutual Information calculation further includes Stochastic sampling 
to compute the Mutual Information. 

[c4] 4. The method for registering a plurality of image sets according to Claim 2, 

wherein the image sets to be registered are capable of differing in at least one 
of temporally, modality, acquisition orientation, and dimensionality. 

[c5] 5. The method for registering a plurality of image sets according to Claim 1 , 

wherein the image sets to be registered are capable of differing in at least one 
of temporally, modality, acquisition orientation, and dimensionality. 

[c6] 6. The method for registering a plurality of image sets according to Claim 1 , 

wherein the selecting of point locations includes selecting corner points of the 
evaluation image set as the selected location points. 

[c7] 7. The method for registering a plurality of image sets according to Claim 1 , 

further including using the selected corner points of the evaluation image set 
before the initial transformation as the fixed reference locations. 

[c8] 8. The method for registering a plurality of image sets according to Claim 1 , 

wherein the location value (C) is an average distance between the one or more 
selected point(s) at the current iteration and the one or more fixed reference 
locations. 

[c9] 9. The method for registering a plurality of image sets according to Claim 1 , 

wherein the convergence value (V) is calculated from the location values (C). 

[cl 0] 1 0. The method for registering a plurality of image sets according to Claim 9, 

wherein location value (C) is low pass filtered to remove noise. 

[cl 1] 11. The method for registering a plurality of image sets according to Claim 1, 

wherein location value (C) is low pass filtered to remove noise. 

t c1 2 3 1 2. The method for registering a plurality of image sets according to Claim 1 , 
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wherein the convergence value (V) for each iteration (i) is defined as a slope over 

the last L iterations as 
2 

V(i) (C (i)-C(i-L 2 ))/L 2 

[cl 3] 13. The method for registering a plurality of image sets according to Claim 3, 

wherein the convergence value (V) for each iteration (i) is defined as a slope over 

the last L iterations as 
2 

V(i) (C (i)-C(i-L 2 ))/L 2 

[cl 4] 1 4. The method for registering a plurality of image sets according to Claim 8, 

wherein the convergence value (V) for each iteration (i) is defined as a slope over 
Q the last L iterations as 

m V » ( C (0-C(i-L 2 ))/L 2 



[cl 5] 1 5. The method for registering a plurality of images sets according to Claim 1 4, 

i wherein convergence is obtained when absolute value of (V) ^ t for at least L 

7± of the last L A iterations such that L ^ L . 

m 4 3 4 

||! [cl6] 16. The method for registering a plurality of images sets according to Claim 1, 

wherein convergence is obtained when absolute value of (V) ^ t for at least L ^ 

of the last L iterations such that L ^ L . 

4 3 4 

[cl 7] 1 7. The method for registering a plurality of image sets according to Claim 1 , 

wherein the transformation of the evaluation image set is one of affine, rigid, 
deformable, and perspective. 

[cl 8] 1 8. The method for registering a plurality of image sets according to Claim 4, 

wherein the transformation of the evaluation image set is one of affine, rigid, 
deformable and perspective. 

[cl 9] 1 9. The method for registering a plurality of image sets according to Claim 1 , 

wherein the transformation applied to the evaluation image set is determined by 
an optimization method. 



fil 
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[c20] 20. The method for registering a plurality of image sets according to Claim 19, 

wherein calculating correspondence further includes at least one of a Powell's 
method optimizer, a steepest gradient descent optimizer, a LBFGS optimizer, a 
Levenberg-Marquardt optimizer, a conjugate gradient optimizer, and a quasi- 
Newton optimizer. 

[c21] 21. The method for registering a plurality of image sets according to Claim 1, 

wherein an image set comprises one or more images. 

[c22] 22. The method for registering a plurality of image sets according to Claim 21 , 

wherein the image set comprises data relating to functional measurements. 

[c23] 23. The method for registering a plurality of image sets according to Claim 21 , 

wherein the image set comprises data relating to anatomical data. 

[c24] 24. The method for registering a plurality of image sets according to Claim 1 , 

wherein the image set comprises data relating to functional measurements. 

[c25] 25. The method for registering a plurality of image sets according to Claim 1 , 

wherein the image set comprises data relating to anatomical data. 

[c26] 26. The method for registering a plurality of image sets according to Claim 1 1 , 

wherein the low-passed filter is defined as 

C,(0 f 1 C(i) 

, wherein L ^ is the length of the low-pass filter. 

[c27] 27. The method for registering a plurality of image sets according to Claim 1 , 

wherein the calculation of the convergence threshold (t) is dynamically 
determined based on the data. 

[c28] 28. The method for registering a plurality of image sets according to Claim 27, 

wherein the calculation of the convergence threshold (t) is dynamically 

determined using a high-pass estimate of (V) to determine the noise level C , 

h 

(I). 

[c29] 29. The method for registering a plurality of image sets according to Claim 28, 

wherein the convergence threshold is defined as t = f + C , (i) * f . 

1 h 2 
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5 8 



[c30] 30. The method for registering a plurality of image sets according to Claim 1 , 

wherein the quality of alignment is voxel based. 

[c31] 31. The method for registering a plurality of image sets according to Claim 30, 

wherein the voxel based quality of alignment is further based on intensity of 
pixels of the image. 

[c32] 32. The method for registering a plurality of image sets according to Claim 31 , 

wherein Mutual Information is utilized to determine quality of alignment. 

[c33] 33. The method for registering a plurality of image sets according to Claim 32, 

wherein Mutual Information further includes stochastic approximation. 

[c34] 34. The method for registering a plurality of image sets according to Claim 1 , 

wherein the quality of alignment is feature based. 



[c35] 35. The method for registering a plurality of image sets according to Claim 34, 

wherein the feature based quality of alignment is further based on edges 
• extracted from the image. 



U ^ c36 ^ 36. A system for registering a plurality of image sets, wherein each of the 

m 

plurality of image sets comprises at least one image, and wherein each of the 
Ft J plurality of image sets contain spatially overlapping areas of an imaged subject 

with at least one of the remaining plurality of the image sets, the system 
comprising: 

means for selecting a reference image set and an evaluation image set from said 
plurality of image sets, wherein the evaluation image set is to be aligned with 
the reference image set; 

means for selecting a methodology for comparing the registration between the 
reference image set and the evaluation image set; 

means for selecting one or more point locations on the evaluation image set for 
tracking image alignment; 

means for selecting one or more fixed reference points for comparison with the 
one or more point locations on the evaluation image set; 
means for selecting type of transformation to apply to the evaluation image set 
for aligning the evaluation image set with the reference image set; 
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a) means for calculating quality of alignment between the reference image set 
and the evaluation image set using the selected feature set; 

b) means for calculating a location value (C) from one or more points on the 
evaluation image set with respect to the selected one or more fixed reference 
points and storing the calculation in the memory; 

c) means for calculating a next transformation to apply to the evaluation image; 

d) applying the transformation to at least a subset of the evaluation image set; 

e) means for calculating a convergence value (V) for the current iteration (i), and 
storing the convergence value to the memory; 

f) means for performing steps (a), (b) (c), (d) and (e) until at least L 

correspondence calculation iterations have been performed; 

g) repeating steps (a), (b), (c), (d), and (e) if a total number of iterations (i) 
performed < N and the convergence value (V) < (t), wherein (t) is a threshold 
value. 

37. The system for registering a plurality of image sets according to Claim 36, 
wherein calculating correspondence further includes calculating Mutual 
Information between the reference image set and the evaluation image set. 

38. The system for registering a plurality of images sets according to Claim 37, 
wherein the Mutual Information calculation further includes Stochastic sampling 
to compute the Mutual Information. 

39. The system for registering a plurality of image sets according to Claim 37, 
wherein the image sets to be registered are capable of differing in at least one 
of temporally, modality, acquisition orientation, and dimensionality. 

40. The system for registering a plurality of image sets according to Claim 36, 
wherein the image sets to be registered are capable of differing in at least one 
of temporally, modality, acquisition orientation, and dimensionality. 

41. The system for registering a plurality of image sets according to Claim 36, 
wherein the calculating location step further includes selecting corner points of 
the evaluation image set as the selected location points. 

42. The system for registering a plurality of image sets according to Claim 36, 
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further including using the selected corner points of the evaluation image set as 
the fixed reference locations before the initial transformation. 

43. The system for registering a plurality of image sets according to Claim 36, 
wherein the location value (C) is an average distance between the one or more 
selected point(s) at the current iteration and the one or more fixed reference 
locations. 

44. The system for registering a plurality of image sets according to Claim 36, 
wherein the convergence value (V) is calculated from the location value (C). 

45. The system for registering a plurality of image sets according to Claim 36, 
wherein location value (C) is low pass filtered to remove noise. 

46. The system for registering a plurality of image sets according to Claim 36, 
wherein the convergence value (V) for each iteration (i) is defined as a slope over 
the last M iterations as 

V(i) (C (i)-C(i-M))/M 

47. The system for registering a plurality of images sets according to Claim 47, 
wherein convergence is obtained when absolute value of (V) < t for at least Q of 
the last L iterations such that Q < L. 

48. The system for registering a plurality of image sets according to Claim 36, 
wherein the transformation of the evaluation image set is capable of being 
limited to one of affine, rigid and deformable. 

49. The system for registering a plurality of image sets according to Claim 39, 
wherein the transformation of the evaluation image set is capable of being 
limited to one of affine, rigid and deformable. 

50. The system for registering a plurality of image sets according to Claim 36, 
wherein an image set comprises one or more images. 

51 . The system for registering a plurality of image sets according to Claim 36, 
wherein the image set comprises data relating to functional measurements. 
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[c52] 52. The system for registering a plurality of image sets according to Claim 36, 

wherein the image set comprises data relating to anatomical data. 

[c53] 53. The system for registering a plurality of image sets according to Claim 36, 

wherein the calculation of the convergence threshold (t) is dynamically 
determined based on the data. 

[c54] 54. The system for registering a plurality of image sets according to Claim 55, 

wherein the convergence threshold is defined as t = f + C (i) * f . 

1 h 2 

[C55] 

55. A software product capable of directing a general purpose computer to 
register a plurality of image sets, wherein each of the plurality of image sets 
p contain spatially overlapping areas of an imaged subject with at least one of the 

K remaining plurality of the image sets, the software product comprising: 

W directing a general purpose computer to execute the steps of: 

y selecting a reference image set and an evaluation image set from said plurality 

■ a F of image sets, wherein the evaluation image set is to be aligned with the 

p reference image set; 

il selecting a methodology for comparing the registration between the reference 

Cfl image set and the evaluation image set; 

f|i selecting one or more point locations on the evaluation image set for tracking 

image alignment; 

selecting one or more fixed reference points for comparison with the one or 
more point locations on the evaluation image set; 

selecting type of transformation to apply to the evaluation image set for 
aligning the evaluation image set with the reference image set; 

a) calculating quality of alignment between the reference image set and the 
evaluation image set using the selected feature set; 

b) calculating a location value (C) from one or more points on the evaluation 
image set with respect to the selected one or more fixed reference points and 
storing the calculation in the memory; 

c) calculating a next transformation to apply to the evaluation image; 

d) applying the transformation to at least a subset of the evaluation image set; 

e) calculating a convergence value (V) for the current iteration (i), and storing 
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the convergence value to the memory; 

f) performing steps (a), (b) (c), (d) and (e) until at least L correspondence 
calculation iterations have been performed; 

g) repeating steps (a), (b), (c), (d), and (e) if a total number of iterations (i) 
performed < N and the convergence value (V) < (t), wherein (t) is a threshold 
value. 

[c56] 

56. A system for registering image sets, the system comprising: 

a data processor, the data processor having a memory, wherein the data 

processor is capable of accessing and directing peripheral devices; 

y a graphical user interface, wherein the graphical user interface is capable of 

interfacing with an navigating an imaging registration software product for 

fi| registering image sets and wherein the software product is capable of 

l ;: : 

instructing the data processor to perform instructions pursuant to the software 
yj- product, the software product comprises: 

■ r an instruction for selecting a reference image set and an evaluation image set 

Q from said plurality of image sets, wherein the evaluation image set is to be 

111 

|- aligned with the reference image set; 

%l an instruction for selecting a methodology for comparing the registration 

f|J between the reference image set and the evaluation image set; 

an instruction for selecting one or more point locations on the evaluation image 

set for tracking image alignment; 

an instruction for selecting one or more fixed reference points for comparison 
with the one or more point locations on the evaluation image set; 
an instruction for selecting type of transformation to apply to the evaluation 
image set for aligning the evaluation image set with the reference image set; 

a) an instruction for calculating quality of alignment between the reference 
image set and the evaluation image set using the selected feature set; 

b) an instruction for calculating a location value (C) from one or more points on 
the evaluation image set with respect to the selected one or more fixed 
reference points and storing the calculation in the memory; 

c) an instruction for calculating a next transformation to apply to the evaluation 
image; 
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d) an instruction for applying the transformation to at least a subset of the 
evaluation image set; 

e) an instruction for calculating a convergence value (V) for the current iteration 
(i), and storing the convergence value to the memory; 

f) an instruction for performing steps (a), (b) (c), (d) and (e) until at least 
predetermined number of correspondence calculation iterations have been 
performed; 

g) an instruction for repeating steps (a), (b), (c), (d), and (e) if a total number of 
iterations (i) performed < N and the convergence value (V) < (t), wherein (t) is a 
threshold value. 

[c57] 57. A system and method for registering a plurality of image sets and 

Lais 

□ determining convergence, the system and the method comprising: 

J;J a) calculating a convergence value (V) for a predetermined number of iterations 

W (i), and storing each convergence value to the memory; and 

u\ b) repeating step (a), if a total number of iterations (i) performed < N and the 

convergence value (V) < (t), wherein (t) is a threshold value. 

m [c58] 5g ^ system and method for registering a plurality of image sets and 

^ determining convergence according to Claim 57, further including at least one 

O of the steps of: 

III 

selecting a reference image set and an evaluation image set from said plurality 
of image sets, wherein the evaluation image set is to be aligned with the 
reference image set; 

selecting a methodology for comparing of the registration between the 
reference image set and the evaluation image set; 

selecting one or more point locations on the evaluation image set for tracking 
image movement; 

selecting one or more fixed reference points for comparison with the one or 

more point locations on the evaluation image set; 

selecting type of transformation to apply to the evaluation image set for 

aligning the evaluation image set with the reference image set; 

c) calculating quality of alignment between the reference image set and the 

evaluation image set using a selected quality of alignment methodology; 
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d) calculating a location value (C) from one or more points on the evaluation 
image set with respect to the selected one or more fixed reference points and 
storing the calculation in the memory; 

d) calculating a next transformation to apply to the evaluation image; and 

e) applying the transformation to at least a subset of the evaluation image set. 

[c59] 
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